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1.  INTRODUCTION 

'v^3ne  of  the  basic  problems  in  statistical  communication  theory  is  that  of 
detecting,  at  the  end  of  a  communication  cnannei.  a  signal  imbedded  in  noise. 

The  Gaussian  model  is  a  model  for  which  the  noise  as  well  as  the  received 
signal  are  Gaussian  processes  with  eauivaient  laws,  so  that  the  resulting 
detection  problem  is  nonsingular.  Unfortunately  "most  solutions  to  problems 
involving  signais  in  Gaussian  noise  are  based  on  a  knowledge  of  the  auto- 

f'  ~~  ~~  - —  y<U, 

correlation  function  or  spectrum  fif  the  noise  is  stationary) .  In  fact,  of 
course,  as  mentioned  before,  they  are  rareiy.  if  ever,  known  precisely"  (19) . 
This  observation  motivates  the  paper  just  quoted  and,  in  it,  its  author  in¬ 
vestigates  the  stability  of  the  decision  functions  based  on  a  model  with  Gaus¬ 
sian  noise  and  covariance  function  R  in  two  ways.  First  he  considers  the 
case  of  Caussian  noise  with  covariance  function  R+A  instead  of  just  R.  How¬ 
ever  "the  restriction  to  Gaussian  measures  were  better  removed  even  though 
the  noise  is  nearly  Gaussian,  if  the  stability  criteria  are  to  be  believable  in 
practice"  (19) .  Stability  is  then  understood  as  a  form  of  continuity  of  the 
decision  functions  when  the  topology  is  that  of  weak  convergence,  a  concept 
which  is  now  widely  used  in  the  field  of  robust  statistical  procedures  (11) . 

Of  course  "this  formulation  does  not  allow  much  hope  for  actually  calculating 
useful  bounds  on  errors"  (19) .  Since  the  most  important  elements  of  a  detec¬ 
tion  problem  are  the  probabilities  of  false  alarm  and  false  dismissal,  one  may 
try  to  study  the  stability  problem  by  taking  an  intermediate  position  between 
the  two  described  above.  This  is  ?he  object  of  the  present  work  and  the  idea 
is  to  look  at  specific  contaminations  of  Gaussian  laws  In  order  to  find  analytic 


expressions  for  the  probability  of  false  alarm  and  that  of  false  dismissal  as 
functions  of  contamination.  The  aim  is  not  so  much  to  produce  models  for  soe- 
cific  Gaussian  disturbances  as  to  get  some  feei  for  what  these  can  do  to  the 
probabilities  of  raise  alarm  and  faise  dismissal. 

It  shall  be  assumed  that  signals  and  noises  have  finite  energy,  that  is  are 
stochastic  processes  with  square  integrable  oaths.  These  will  induce  probability 
measures  on  the  Borel  sets  of  L  ^[0. 1)  ,  the  space  of  equivalence  classes  of 
square  integrable  functions.  L  ,{0,1)  is  a  standard  separable  Hilbert  space 
and  it  is  notationaily  simpler  to  work  with  a  general  separable  Hilbert  space  H, 
which  we  shall  do.  B  (H)  is  the  sigma  algebra  generated  by  the  open  sets  of  H 
and  is  the  smallest  sigma  aigebra  which  makes  all  continuous  linear  functionals 
<*,h>  ,  h  in  H,  measurabie.  <•,•>  is  the  inner  oroduct  of  H  and  the  corres¬ 
ponding  norm  is  j  j  •  !  | .  All  measures  considered  shall  be  defined  on  B(H) . 

They  are  typically  obtained  as  follows.  If  X(w,t)  is  a  stochastic  process  defined 

T 

on  the  probability  space  (fi.A.y  )  such  that  S  X"  (w.t)  dt  is  finite  fory-almost 

0 

every  u  ,  it  induces,  on  B(H) .  a  measure  P  defined  by 

A 

Pj^{x  in  H:  <x,h1>  in  B^, . . . ,  <x,hn>  in  B^}  * 

=  P{winn:  <X(w  .•}.!%>  in  B . <X(u,*).h  >  in  P  }, 

ii  n  -n 

where  h. , . . .  ,h  belong  to  H  and  B  , - B  belong  to  B  (DO ,  the  Borel  sets  of 

1  n  ^ 

IR.  Here  <X(w,*),h>  =  /  X(w,t)  h(t)  dt. 

0 

If  S  denotes  the  signal  and  N  the  noise,  the  detection  problem  (N.S+N)  is 
nonsingular  if  Pg+N  and  P^  are  mutually  absolutely  continuous,  that  is  Pg+|^(B)  =  ® 
if  and  only  if  pN(B)  =  0  for  Borel  B  in  B(H) .  The  singularity  of  a  detection  pro¬ 
blem  on  a  space  of  infinite  dimension  is  notoriously  unstable  (19) .  Consequently, 


-il- 


fo  r  reasons  analogous  to  those  which  reauire  detection  orobiems  to  be  nor.- 
singuiar  (3. 14, 18) .  attention  shall  be  restricted  to  iaws  which  are  not  oniy 
in  the  neighbournood  of  Caussian  laws  but  aiso  equivaient  to  these. 

One  tool  which  has  proved  useful  in  investigations  dealing  with  robust 
statistical  procedures  is  that  of  contamination  (21) .  Let  P  be  the  law  of  the 
chosen  model;  its  contaminations  are  of  the  form  Pc  =  (l-tjP+sQ,  where  Q 
is  some  probability  measure  and  0  <  z  <  1.  If  P  =  P^  and  Q  =  Qy  and  U  is  a 
random  variable,  independent  of  X  and  Y,  which  takes  the  value  1  with  pro¬ 
bability  1-e  and  the  value  0  with  probability  e  ,  then  Pc  is  the  law  of  Z  = 
UX+(1-U)Y,  that  is  the  paths  of  Z  are  obtained  by  sampling  among  those  of 
X  and  Y  according  to  the  law  of  U.  In  this  paper  we  shall  use  two  types  of 
contaminations.  The  first  type  iTI-contaminations)  is  constructed  with  mea¬ 
sures  Q  which  are  Gaussian  and  the  second  type  iT2-contaminations)  with 
measures  Q  which  are  absolutely  continuous  with  respect  to  P  and  have  a 
quadratic  form  as  Radon-Nikodym  derivative.  The  use  of  such  simpie  conta- 
minations  has  a  number  of  advantages.  First  of  all,  their  covariance  has  the 
form  R+A  so  that  we  have  a  nongaussian  generalization  of  the  stability  study 
within  the  Caussian  model,  as  in  (19) .  Moreover,  the  situation  is  at  the  same 
time  sufficiently  simple  so  that  one  can  obtain  analytic  information  on  the  pro¬ 
babilities  of  interest,  and  sufficiently  complex  so  that  one  can  exhibit  features 
which  do  not  appear  in  the  Gaussian  perturbation  model. 

The  first  part  of  the  paper  deals  with  the  basic  properties  of  the  contamina¬ 
tions  just  introduced.  We  show  in  particular  that  they  share  with  Gaussian 
laws  many  properties,  the  main  exception  being  that  they  do  not  necessarily 
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converge  weaklv  to  laws  of  the  same  tvpe.  in  the  second  oart  of  the  oaoer  we 
use  these  contaminations  to  study  the  stability  of  the  detection  problem  in  case 
of  sure  signal  and  additive  Gaussian  noise.  Besides  giving  a  number  of  Quanti¬ 
tative  and  quaiitative  resuits  involving  actual  and  nominai  probabilities  of 
false  alarm,  we  are  abie  to  show  that  weak  convergence  alone  fails  in  general 
to  control  the  behaviour  of  the  parameters  which  determine  the  probabilities  of 
false  alarm:  what  reailv  matters  is  the  way  in  which  this  convergence  takes  place 
Finally,  we  show  that  the  type  of  contamination  which  is  considered  plays  an 
important  role.  Thus  contaminations  by  Gaussian  laws  result  in  worse  patholo¬ 
gies  than  contaminations  of  the  second  tvpe  considered:  the  former  have  in  a 
sense  "too  many  degrees  of  freedom"  for  weak  convergence  to  control . 

We  consider  here  only  the  detection  of  sure  signals.  For  some  results  in  the 
case  of  stochastic  signals,  see  (7) .  Proofs  are  outlined  in  the  appendix. 


2.  CONTAMINATIONS 

P  will  always  denote  a  Gaussian  probability  on  B(H) .  It  is  determined  by 
its  mean  rrip  and  its  covariance  operator  Rp,  and  we  shall  write  P  *  N(mp,Rp) . 
mp  is  an  element  in  H  and  is  uniquely  determined  by  the  relation 

Ep<-,h>  =  <mp,h>.  for  alt  h  in  H. 

In  case  P  =  P  .  mp  is  the  mean  function  of  X.  The  operator  Rp  is  uniquely  de¬ 
termined  by  the  relation 


E  * <*,h>-<m_,h>M<*,k>-<m  ,k>}  *  <R  h,k>,  for  all  h  and  k  in  H. 
P  P  P  P 

In  case  P  =  Px  and  (s. t)  is  the  covariance  of  X,  Rp  is  defined  by 

R  I)  (t)  =  /  R  (t,u)  f(u)  du. 

P  o  * 


Let  (a©b)  (x)  =  <b.x>a.  Then  R„  has  the  reoresentation 

r 

* 

»  k=1  * 

where  \  »  0,  2  \  <  •  and  {e,  }  is  a  complete  orthonormai  set  in  the  closure 

k  k=1  k  k 

of  the  range  of  R^. Since  this  iatter  set  is  the  suooort  of  P.  one  can  always  sup¬ 
pose  it  is  H.  is  an  eigenvector  of  R^  corresponding  to  the  eigenvalue  It 
has  been  shown  that  Gaussian  measures  P  on  the  Borei  sets  of  L,  (0,1)  are  all 


of  the  form  P  ,  X  a  Caussian  process  with  paths  in  L,{0, 1)  (15) .  The  Fourier 

A  *” 

transform  of  P,  FTP.  is  given  by  the  relation 


FTP(h)  =  E  (exp{i<‘,h>»  =  exo{i<mp, h>-*<Rph.h>} . 

If  P  =  P  ,.FTP(th)  is  the  characteristic  function  of  the  random  variable  <X(-,*)  ,h>, 

A 

t  real . 

For  T1 -contaminations,  we  choose  Q  ~  N  (m  ,R_) ,  while  for  T2-contaminations 

Q  Q 

we  choose  dQ=  C”1 1  |A^  (x-a)  j  ]  “  dP.  A  is  an  operator  whicn  is  linear,  continuous, 
positive  and  self-adjoint,  a  is  a  fixed  element  in  H  and  C  =  trace{A(Rp+(mp-a)©(mp 
c  is  chosen  to  be  C(c-K^)-1,  where  c  is  nonnegative.  We  have  already  indicated 
that  contaminations  can  be  thought  of  as  the  laws  of  processes  Z  =  UX+(1-U)Y, 
where  X  has  law  P  and  Y  has  law  Q.  We  are  going  to  add  the  requirement  that  X 
and  Y  have  the  same  set  of  paths.  One  way  to  achieve  this  is  to  require  that  P 
and  Q  be  mutually  absolutely  continuous,  so  that  they  have  the  same  support.  In 
this  way,  we  discard  cases  such  as  those  for  which  X  would  have  continuous  paths 
and  Y  discontinuous  ones,  for  which  no  doubt  would  exist  as  to  which  of  P  and 
Pc  obtains.  For  examples  of  T2-contaminations,  see  (8,9).  In  particular  T2-con- 
taminations  of  stationary  processes  ycld  harmonizable  ones.  We  thus  have 


Proposition  1 
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If  P°  is  a  T1 -contamination,  P  and  P*"  are  mutually  absolutely  continuous  if 
and  only  if  P  and  Q  are.  P  and  its  T2-contaminations  are  at  wavs  mutually  abs¬ 
olutely  continuous.  / 

The  first  assertion  follows  from  the  dichotomy  theorem  for  Gaussian  measures 
(10)  and  the  second  is  a  consequence  of  a  zero-one  law  for  Gaussian  measures 
(2). 

Assumption 

P  and  Pc  are  henceforth  assumed  to  be  mutually  absolutely  continuous./ 

We  shall  first  need  the  mean  m  and  the  covariance  R  of  P*-.  A  direct  cal- 

c  c 

culation  yields 
Proposition  2 

For  T1 -contaminations  m  =  (1-e)m  +em_  and 

c  P  Q 

Rc  =  (1-e)Rp+eRQ+e(1-e)  (mp-mQ  )®(mp-m^) . 

and  for  T2-contaminations  m  =m  +2(c+C)_1R  A(m  -a)  and 

c  P  P  P 

R  =  R+2  (c+C)_1R  AR  -4(c+C)'2R  A(m  -a)®(m  -a) ARD. / 
cP  PP  PP.Pp 

Remark  1 

From  Proposition  2  it  follows  that  both  types  of  contaminations  have  a  mean 

and  a  covariance  of  the  same  form,  that  is 

m  =  m  +R*b  and  R  =  Rifl+T+i  t®t)R^. 
c  P  c  P  P 

(P  and  Q  have  been  chosen  equivalent  in  the  T1  case  so  that  in  particular 

belongs  to  the  range  of  R^)  -  These  are  essentially  the  conditions  which  ensure 

that  a  Gaussian  law  with  mean  m  and  covariance  R_  is  equivalent  to  P  (16) , 

c  c 

so  that,  even  if  Pc  is  wrongly  assumed  to  be  Gaussian,  there  is  no  way  to  dis¬ 
criminate  surely  between  P  and  P0. 
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For  every  fixed  h  in  H,  one  may  define  a  real  random  variable  X{h}  by  set¬ 
ting  X{h}(x)  =  <x,h>.  x  in  H .  For  T1  -contaminations,  the  law  of  X{h;  with 
respect  to  Pc,  defined  by 

Pc  (B)  =  PCfx  in  H:  X{h>(x)  in  B) ,  B  in  B(CR), 

X{h} 

is  the  obvious  mixture  of  the  laws  of  X(h>with  respect  to  P  and  Q.  For  T2  - 
contaminations  one  has 
Proposition  3 

Let  a(h)  =  2(c-*-C)-1  <RpA{mp-a)  ,h>, 

3(h)  =  2(c+C)~1  <RpARph,h>, 

4  (t)  =  exp{it<mp,h>-$t2<Rph,h  >}  . 

The  characteristic  function  *  of  the  random  variable  X{h)  with  respect  to  P0 , 

a  T2-contamination.  is  given  by 

*(t)  =  {1*ia(h)t-j3(h)t2H(t). 

Leta(h)  =1-(c+C)  1  (<R  AR  h,h>/<R  h,h>t, 

P  P  P 

b(h)  =2(c+C)-1  {<RpA(mp-a),h>/<Rph,h>}. 

c(h)  =  (c+C)-1  {<R  AR  h,h>/<R  h, h>2}, 

P  P  P 

C(y)  =  Caussian  density  with  mean  <mp,h>  and  variance  <Rph,h>. 

The  density  g  corresponding  to  4  is  given  by 

g (y)  -  (a(h)+b(h)  (y-  <mp,h>)+c(h)  (y-<mp,h>/}C(y) ./ 

Remark  2 

Suppose  that  a  *  mp  and  let  z  =  (y-<nip,h>)/<Rph,h>*, 

L2  =  (c+C)"1  {<RpARph,h>/<Rph,h>}, 

2 

and  K  =  {2ir<Rph.h>}*. 

The  density  g  of  Proposition  3  can  then  be  written 


-9- 


g(y)  =y(z)  =  K2{i-L2+L‘’z2;exD{-iz2} . 

If  L2  <  1/3,  for  which  a  sufficient  condition  is  (c+C)  '  'R^AR^j  J  <  1/3,  y  has 

a  unique  maximum  for  z  =  0.  Otherwise  y  presents  two  symmetric  peaks.  Laws 
with  such  densities  have  been  shown  to  model  some  tvpes  of  noise  (17) .  Since 

1  1  1  A 

R^ARp1  is  a  compact  operator,  <RpARph,h>/<Rph,h>  =  <R*ARpk,k>.  with  k  = 
Rph/  |  |R$h|  |,  will  be  smail  in  all  but  a  finite  number  of  directions.  This  shows 
the  kind  of  departure  from  normality  one  can  expect.  A  sink  which  would  appear 
in  the  density  of  all  functionals  would  eventually  touch  the  origin,  making  the 
law  singular  with  respect  to  the  Gaussian  one.  To  obtain  two  peaks  with  T1 -con¬ 
taminations,  one  would  need  distinct  means.  The  peaks  would  then  appear  in  e- 
very  direction,  but  the  sink  would  be  controlled  in  size.  Another  interesting 

feature  of  the  density  g  is  that  it  is  normal  for  h  in  the  kernel  of  R  AR  .  The 

P  P 

measure  P°  can  thus  exhibit  a  Gaussian  behaviour  in  many  directions  without  ac¬ 
tually  being  Gaussian.  This  "Gaussianness"  is  controlled  by  the  range  of  A.  This 
feature  is  absent  in  the  case  of  T1 -contaminations. 

0 

One  space  of  interest  in  linear  inference  problems  is  the  closure  in  the  real 

L2-space  L2(PC)  of  the  set  (X{h},h  in  H)  of  random  variables.  This  subspace  is 

called  the  linear  space  of  Pc  and  is  denoted  L (P0) .  This  terminology  arises  as 

follows:  if  Pc  =  P  ,  linear  operations  on  X  are  of  the  form  <X(-,-l  ,h>  *  X{h) . 

X 

L(P)  contains  only  normal  random  variables.  The  next  result  states  that  L(PC) 

also  contains  random  variables  which  all  have  a  law  of  the  same  type. 

Let  Pc  be  a  contamination  and  S£  be  the  operator  Rc4-mc©mc.  If  f  belongs  to 

L(PC),  the  following  relation  defines  an  element  of  K  denoted  h(f): 

h  /  =  /  xf(x)Pc(dx) . 

H 


For  two  such  'elements,  h(f)  and  h(g) ,  one  can  define  the  inner  product' 


<h(f),h(g)>  =  E  (fa). 

HfP0)  Pc 

Let  H(PC)  =  <h  (0  ,  f  in  L(PC) }  and  define  U  :  L(PC)-K  fPc)  by  U  (f)=hff). 

pc  pc 

H(PV')  is  then  a  Hilbert  space,  contained  in  H  as  a  subset,  and  U  is  a  unitary 

Pc 

operator.  As  a  set,  H(PC)  is  the  range  of  S|  and  is  isomorphic  to  the  reprodu¬ 
cing  kernel  Hilbert  space  of  the  process  (X{h;.h  in  H)  (Lemma  1,  Appendix)  . 

Let  now  B  be  the  operator  from  LtPc)  to  H  defined  by  Bf  =  R^S  “U  f.  B  is  well 

P  Pc 

defined  and  continuous  iLemma  4.  Appendix)  .  Since  <R  h,h>  <  <S  h,h>,  = 

c  -  c  c 

S^WC,  where  Wc  is  a  bounded  operator  on  H(5)  .  Recalling  that  mc  =  rrip+Rj*b  and 
that 

1) ,  one  has 
Proposition  4 


R  =  R^  (l+T+tt©t)R^  =  R*  {l+T}R*  (Proposition  2  and  Remark 

C  P  P  p  r 


Let  f  belong  to  L(PC)  and  h,h  belong  to  H.  Suppose  that  U  f  =  STi  and 

n  pC  .  c 


h  =  lim  h  (We  have  assumed,  which  is  no  restriction,  that  P  has  full  suo- 
c  n 

port.  This  implies  that  H  is  the  closure  of  the  range  of  Sr.  .) .  Then: 

1)  there  exists  m  in  H  such  that  lim  <m.h  >  =  <m,h>  (If  m  belongs  to  the 

P  n  “ 

range  of  R^,  <m,h^  =  <R~*mp, Bf>.); 

2)  E  (f)  =  <m. h>+<b,  Bf>  (If  m  belongs  to  the  range  of  R  *  ,  E  (f)  = 

pc  P  p  Pc 

<b+Rp*mp,Bf>.); 

3)  V  (0  =  !!0+T)*Bf|[2=  ||WV|!2; 

Pc  C 

4)  For  T1  -contaminations,  the  characteristic  function  $  of  f  is  given  by 


-n- 


(t)  =  (tl+eijlt)  ,  where  <4,  is  the  characteristic  function  of  a 

2 

N(<m,h>,  J  ; B f  |  |  ) -random  variable  and  2-  is  the  characteristic  function  of 

.  *  ,  .2 

a  N  (<m,  h>-<R"t  (m_-mn) ,  Bf>,  i  iW  h;  ) -random  variable;  for  T2-contamina- 
P  P  'J  c 

2  i  ,2 

tions,  <p  (t)  =  0+it<b,  Bf>— -it  ;  iT-Bf!  i  )  ^ ,  (t)  .  / 

This  result  yields  a  useful  computational  tool,  stated  as  a  corollary. 

Corollary 

Let  fi . f  belong  to  L  (Pc1  and  h. .....  h  solve  U  f.  =  S ?h  .  Write  m, , 

n  n  pc  i  c  i 

*  -i 

;-i7,  rr. ,  for  the  n-vectors  with  resDective  entries  <m,h.>, -<8  R  (m  -rr  ),f.> 

3  I  P  P  Q  ■  L(pC) 

It 

<B  b,f.>  ,  and  M . , M , , M ,  for  the  (n*n)  -matrices  with  resDective  entries 

'  L'(PC) 

*  *  * 

<B  Bf.,f  >  ,<B  (l+T  )Bf.,f.>  ,<B  TBf.,f. >  ,  where  T  solves 

i  J  L(pc}  Q  «  J  L{pc)  i  J  L{pC}  Q 

I  t  £ 

Rq  =  Rp(l+7^)Rp  Then,  if  M 1  has  an  inverse,  (f^-.-.M  has  a  density  g 
given  by,  in  case  of  i  1-contaminations,  g(x  )  =  (1-e)  g,  (x  ) +eg,  (x  ) ,  where  g  , 
is  the  density  of  a  N  (m  , ,  M  , ) -random  vector  and  g2  is  the  density  of  a  N  (in  , -m  2,M2)  - 
random  vector,  and,  in  case  of  T2-contaminations. 

—1  -►  -fc.  —  1  -►  -i  «- 1  ■+  -V 

g(x  )  =  (l-tracefM,^  M2)-<  x-m  ,  m3>+i<M.  MyWj  (x -m  ,) ,  (x -m  ^  >)g,  (x  ) .  / 

There  are  two  reasons  which  explain  the  effectiveness  of  Gaussian  laws  for 
solving  problems  of  detection  and  estimation.  The  first  is  that  their  nonlinear 
space  L2(P)  is  the  direct  sum  of  the  symmetric  tensor  powers  of  their  linear 
space  L(P)  (12) ,  which  roughly  means  that  the  elements  in  L,(P)  are  limits  of 
sums  of  polynomials  of  increasing  order  evaluated  at  an  orthonormal  basis  for 
L(P) .  The  second  reason  is  that  the  set  of  Gaussian  laws  is  closed  for  the  topo¬ 
logy  of  weak  convergence.  It  can  be  checked  that  the  first  result  remains  true 


Y* 


>■  %***■■ 


-12- 


i 
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* 


for  Tl-  and  T2-  contaminations.  The  second  however  no  longer  obtains:  the  set 
of  contaminations  is  not  closed  for  weak  convergence,  as  the  following  results 
show,  and  it  is  at  the  boundary  that  cathologies  occur. 

Proposition  5 

C 

Let  (P  ,n  in  N)  be  a  family  of  Tl-contaminations  which  converge  weakly  to 
n 

\ 

the  probability  M.  If  lim  inf  t  =  0  or  lim  sud  e  =  1 ,  M  is  Gaussian.  Otherwise  i 

n  n 

M  =  where  M.  and  M2  are  Gaussian  and  0<u  <1 .  M  is  not  neces¬ 

sarily  a  Tl-cortaminatiun  and  is  Gaussian  if  and  only  if  Mj  =  (in  particu¬ 
lar  Mj  and  .Vt2  need  not  be  mutually  absolutely  continuous)  ./ 

Proposition  6 

Let  (PC.n  in  N)  be  a  family  of  T2-contaminations  which  converae  weakly  to 
n 

the  probability  M.  M  has  then  a  characteristic  function  i  given  by 
$  (h)  =  (1+i<d,h>-<S^VS^h,h>)  exp(i<n,h>~i<Sh,h>) , 

where  S  is  a  linear  operator  which  is  compact,  nonnegative  and  seifadjoint  and 

V  is  linear  and  bounded  (to  have  a  T2-contamination,  one  needs  anS  which  has 

1  1 

finite  trace  and  a  V  of  the  form  S_WST) .  S  has  finite  trace  in  one  of  the  following 
two  cases: 

1)  0<lim  inf  (C  /(c  +C  )  Him  sup(  C  /  (c  +C  )}<1; 

n  n  n  -  n  n  n 

2)  if  a_ (h)  is  zero  when  !|R^h||  is  and  (c  +C  )  (<  R  A  R  h,h>/<  R  h,h>) 

n  n  nn  nnn  n 

otherwise  and  if  3  (h)  is  zero  when  i  |R^h i  |  is  and  <b  ,h>/<R  h,h>  otherwise,  tl 

n  n  n  n 

sup(ci  (h)  ,n,h)  <1  and  sup(  I  3  (h)  |  ,n,h)  <1 ./ 
n  n 

3.  STABILITY  OF  SINGULARITY 

Consider  two  Gaussian  measures  P.  and  P2  representing  respectively  the  law 
of  the  noise  and  the  law  of  the  received  signal  in  some  detection  problem.  Detec- 
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tion  is  nonsingular  if  and  only  if  m,-m„  belongs  to  the  range  of  the  sauare 

i 

root  of  r  (Rj+R2)  and  if  R.,  =  R?  (I+T)R‘  with  T  Hilbert-Schmidt  and  c(T)  >-1 
(o(T)  denotes  the  spectrum  of  T)  (16) .  Suppose  now  the  actual  laws  one  deals 
with  are  pf  and  Pj  .  Tl-  or  T2-contaminations .  possibly  of  a  different  type. 

The  following  resuit  proves  that  the  criterion  for  singularity  which  applies 
in  the  Gaussian  case  applies  to  Tl-  and  T2-contaminations  as  well,  so  that 
singularity  is  stable  over  the  class  of  Tl-  and  T2-contaminations. 

Proposition  7 

Let  P9  and  P*:  be  Tl  -  or  T2-contaminations  with  respective  means  m 

1  2  c.l 

and  m  and  covariances  R  and  R  .  The  detection  problem  (pf,P^) 

C, 2  C, 1  C,2  -  2 

is  either  singular  or  nonsingular  and  it  is  singular  if  and  only  if  m  -m 

C  •  1  C ,  2 

belongs  to  the  range  of  the  square  root  of  *  (R  +R  1  and  if  R  = 

c.l  c,  2  c,2 

R*  (l+S)R*  ,  S  Hilbert-Schmidt  and  c(S)>-1 .  Furthermore,  if  the  detec- 
c.i  c>2 

tion  problem  is  nonsingular,  dPj/dP*",  =  (dP^/dPJ  (dPj/dP^  (dP^'dPf)  ./ 

4.  DETECTION  OF  SURE  SIGNALS 

One  observes  a  sure  function  which  can  have  two  possible  sources:  it  is  either 

a  noise  sample  N  or  a  distorted  signal  sample  s+N,  where  s  is  known.  The 

nominal  model  is  that  model  for  which  the  law  P  of  the  noise  N  is  Gaussian 

with  mean  zero  and  covariance  R_  of  the  form  E  \  e  @e  ,  as  defined  in 

P  n  n  n  n 

the  introduction.  The  actual  model  is  the  model  for  which  the  law  of  N  is  Pc, 
with  mean  zero.  The  nominal  model  represents  the  model  actually  used  and 
the  actual  model  represents  the  system  which  is  being  investigated,  the  "true" 
model.  The  corresponding  detection  problem  is  nonsingular  whenever  s  be¬ 
longs  to  the  range  of  the  square  root  of  Rp(6),  which  is  isomorphic  to  the 
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reproducing  kernel  Hilbert  space  of  R  (Lemma  1.  appendix) .  Since  R^.  and  R 

P  P  pc 


have  square  roots  with  identical  rangesfLemma  4.  appendix) .  the  detection 
problem  is  nonsinguiar  for  the  actual  as  well  as  for  the  nominal  model.  It  shall 
henceforth  be  assumed  that  detection  problems  are  nonsinoular. 

The  maximum  likelihood  decision  function  for  the  nominal  model  is  given  by 
D(X)  =  Z  (sn/'Xn)  X5en)  with  sn  =  <s.en>  and  XCe^  (y)  =  <y,e^>  (19)  1 


A.  The  case  of  T1  -contaminations 


By  choice,  P  =  (1-sjP+eQ  with  Q  <v  N(m  ,R  )  and  P  and  Q  mutually  absolu¬ 
te  Q  7 


tely  continuous.  Then  (i-*-T^) R^,  TQ  Hilbert-Schmidt  and  a(TQ)>-1(16)  . 


Since  mp-=  m  =  0,  mn  =  0  (Proposition  2) .  Let  e  . . e  span  the  ranae 

r  W  n+i  n+p 


of  the  projection  i  C  .sjju  R‘^s !  J‘+e !  JT*  w  R“*  sj  !*  and  C,  =  J  |*  R"*si]* 

n.p  I  "  n,p  K  Q  n,p  P  2  1 '  n,p  p  ■  ' 


Then  E  {n  jP  (s./X-)X  fe. equais  C,  if  X  =  N  and  equals  C,-fC,  if  X  =  s+N, 
Pc  i=1  '  ‘  12 


so  that  D(X)  belongs  to  L2 (PC) .  When  X  =  N,  let  be  a  normal  random  variable 

_i  2 

with  mean  zero  and  variance  I  |R  ?s  j  ]  ,  and.  when  X  =  s+N,  let  Y  have  the 

P  . 1 

same  law  and  variance,  but  mean  equal  to  the  variance.  Similarly,  let  be 

-4  2 

normal  with,  when  X  =  N,  mean  zero  and  variance  |  |R  s|  |  ,  and,  when  X  =  s+N, 

-1  2  -i  2 

mean  ]  J R  1  s|  J  and  variance  I  )R  s  1 1  .  Let  f  and  f  be  the  respective  den- 
p  Q  '  2 

sitiesofYj  and  Y  .  ThenD(X)  has  density  f(x)  =  (l-eHj  (xj+ef^lx) .  Finally 
let  p3  =  PC{D (X) >a jN)  and  pn  =  P{D(X)>aiN).  Then  pa-pn  =  e (Q{D (X) >a|X=N)-pn)  . 
♦  denotes  the  distribution  function  of  a  N (0, 1) -random  variable.  The  polar 
decomposition  (22)  yields  R-  =  R^(I+Tq)$U,  where  it  is  no  restricition  to  sup- 
pose  U  unitary,  so  that  R^  =  UJ  (I+Tq)  “iRpi.  Let  B  =  a/  J  ]Rp  s  ! !  . 
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s  =  RpS/  !  |Rp*  s  I  ! ,  t  =  !  j  (l+T^)  M|.  Then  pn-pa  =  e{t  (B)-t  (8t)  }. 
Proposition  3 

Fix  s  and  8  >  «  _1  (3/4) .  Then 
1 )  A  =  sup  ( [pa-pn  | ,  P0  a  Tl  -contamination }  =  $  (6 ) 


2)  there  exists  (P^,k  in  N)  such  that  W-lim  p£  =  P  (W-  indicating  weak  con¬ 
vergence)  and  lim^p^-p^  }  =  A  .  / 

The  reason  for  2)  is  that  P  and  Pc  can  be  close  in  the  sense  of  weak  convergence 
as  well  as  close  to  beirg  orthogonal .  The  result  also  snows  that  the  discrepancy 
between  pa  and  pn  can  increase  with  the  level  of  the  test. 

Proposition  9 

There  exist  sequences  t'Pc,s.  ,k  in  M)  such  that  W-lim  Pf  =  P,  lim  s.  =0  and 

k  K  k  k 

»»nv|pa-p"  \  =  1-S  (8)  ./ 

*  k  k 

The  reason  for  this  phenomenon  is  that  the  class  of  admissible  signals  is  too 
large  for  'pa-pn  j  to  be  controlled  by  weak  convergence. 

Another  way  to  compare  pa  and  pn  is  to  look  at  the  ratio  pa/pn.  One  has 
pa/pn  *  1-e+e{  (1-t  (St)  )/(!-♦  ( B )) } . 

As  a  function  of  t,  pa/pn  decreases  from  (8))  1  to  1-e.  One  thus 

has  pa<pn  if  t>1  and  pa>pn  if  t<  1 .  When  the  level  of  the  test  increases,  the 
behaviour  of  pa  n  depends  on  the  relative  behaviour  of  S.cand  t.  Suppose  thus 
that  t  goes  t  >  °r  than  3  goes  to  infinity:  pa/pn  is  unbounded,  so  that 
pn  goes  to  zei  .an  pa.  If  now  c  goes  to  1  ard  t  goes  to  infinity,  pa/pn 

goes  to  zero  so  that  pa  goes  to  zero  faster  than  pn.  We  have  seen  in  Propositions 
8  and  9  that  this  behaviour  can  occur  as  p£  converges  weakly  to  P. 


As  the  examples  considered  show,  weak  convergence,  when  c  does  not  go 


to  zero,  depends  an  the  behaviour  of  R:T  R*  whereas  the  behaviour  of  !pa-pn! 

P  Q  p 

and  pa/pn  depends  on  that  of  T  and  these  behaviours  are  not  necessarily  rela- 


C  3 

Let  now  P  be  the  law  of  s+N  and  o  be  the  probaDility  of  false  alarm  for  the 

5 

maximum  likelihood  detector  for  the  actual  detection  model,  that  is  pa  =  PCfdP^/c!Pc>,i}. 
Again  one  wouid  like  to  know  to  what  extent  pn  =  PfdP./dPxi)  is  a  "good"  approximation 
of  pa .  Let  k  =  {1  -£■*•£  (dQ/dP)  {1-e+e  (dQs/dQ)  fdQ/dP)  (dP/dPs)  } .  Then 
dP^/dP4-  =  k{dPs/dP),  so  that  k  represents  the  effect  of  contamination.  The  following 
assumptions  allow  one  to  obtain  a  manageable  form  for  k  and  will  be  made  for  the 
remaining  part  of  this  section. 

Assumptions 

1)  s  belongs  to  the  range  of  R^  (which  is  a  subset  of  the  range  of  R  *) , 

2)  R_  and  R  have  the  same  ranae. 

P  Q 

3)  R^-Rp1  has  a  symmetric  ciosure  C  whose  domain  has  P-probability  one. 

In  particular,  when  Rq  -Rp^  ’s  bounded  on  ihe  range  of  Rp,  C  is  bounded  and 
self-adjoint  (16).  Let  K(x)  =  (l-c)det  ^(l+Tgl+texpC-: }<Cx,x>).  Then  k(x)  = 
K(x-s)/K(x)  (16) .  Thus,  whenever  s  belongs  to  the  kernel  of  C,  the  actual  and 
the  nominal  probabilities  are  the  same.  One  however  has 
Proposition  10 


The  range  of  k  can  be  (x  in  tR:0<x<«}./ 

Proposition  10  shows  that  the  values  taken  by  the  actual  and  nominal  likelihoods 
can  be  quite  different.  Since  the  global  behaviour  of  k,  as  a  function  of  e,  C  and 
Tg  is  difficult  to  analyze,  one  may  try  to  evaluate  k  at  critical  points.  There  are 
two  of  these  of  particular  interest,  0  and  s,  at  which  one  presumably  would  deci- 
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de  that  respectively  no  signal  or  a  signal  has  been  sent.  Since  k(s)  *  l/k(0),  it 

suffices  to  consider  kfO) .  It  is  shown  in  the  next  proposition  that  k(0)  can  be  as 

.  2 

large  as  expt}  j  i Rp*s  j  |  }  which  is  the  vaiue  taken  by  the  nominal  likelihood  when 
the  exact  signal  has  been  received.  The  actual  likelihood  has  then  the  value  one, 
whereas  the  nominal  likelihood  can  be  very  small. 

Proposition  11 

sup(k(0)le,Q}  >  exp{?  1 1 R~- s 1 |2}./ 

Here  again,  the  bound  can  be  approximated  when  P°  is  close  to  P  in  the  weak 
sense.  Formulae  for  pa  are  quite  complicated  and  only  in  particular  cases  can  one 
obtain  global  bounds  for  pa  in  terms  of  pn.  Here  is  one  case  which  shows  what 
kinds  of  restrictions  are  then  required. 

Proposition  12 

« 

Let  Bk  =  1+{ek/ (l-e^det1  (l+T^  )  }.  Suppose  that  Gk  is  nonnegative  and  that 
8k  <  M<  • .  Then,  for  a>0  and  W-lim  P£  =  P. 

PtdP  /dP>aM}  <  lim  inf  P^{dP^  /dP?>cx>  <  lim  sup  pf  {dP*  /dPf >*}  <  P{dP  /dP>a/M) 
Thus  a  uniform  bound  on  the  admissible  perturbations  is  required  and  the  bounds 
obtained  are  good  only  if  the  perturbation  is  uniformly  small . 

B.  The  case  of  T2-contaminations 

The  features  of  T1 -contaminations  exhibited  above  indicate  that  stability  results 
can  only  be  obtained  by  restricting  the  class  of  signals  and/or  knowing  some  a 
priori  uniform  bounds  on  the  perturbations  one  must  consider  (we  have  in  particu¬ 
lar  assumed  in  Propositions  10,  11  and  12  -  see  the  "Assumptions"  preceding  the¬ 
se  statements  -  that  the  signal  belongs  to  the  range  of  Rp,  rather  than  to  the  range 
which  is  imposed  by  a  nonsingular  problem) .  In  this  sense,  Tl-contamina-  ' 


.KVi  .ft 
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tions  have  "too  many  degrees  of  freedom".  One  can  thus  attempt  to  obtain  stability 
results  by  restricting  the  class  of  contaminations  considered.  This  is  what  one  a- 
chieves  by  introducing  T2-contammations.  Whereas  e  and  Q  act  as  independent 
variables  for  Tl-contaminaticns,  for  T2-contaminations,  z  depends  on  Q  in  the  sense 
that  e  =  C/'  (c+C) .  where  C  is  a  function  of  the  parameters  which  determine  Q  (  see 
in  particular  the  proof  of  Proposition  1 3) .  Intuitively,  T2  -contaminations  are  ob¬ 
tained  from  T1 -contaminations  by  keeping  the  first  terms  of  the  Taylor  expansion 
of  the  likelihood  of  Q  with  respect  to  P.  This  indicates  that  classes  of  contaminations 
intermediate  between  T1-  and  T2-contaminations  can  be  obtained  by  keeping  more 
terms  in  the  Taylor  expansion  considered  above. 

It  is  again  assumed  that  m  =  0,  which  is  achieved  by  setting  R  Aa  =  0.  As  in 

^  P 

the  case  of  T1 -contaminations,  one  may  check  that  D  (X)  belongs  to  L2  (P0) .  Let 

»  1  2  -X 

be  the  same  random  variable  as  in  A.  and  ^  be  its  density.  Let  e  =  j  |A*s|  |  /  (c+C)  |  |Rp1 

and  f2tx)  =  x2fj  (x)  /  I  ]Rp^s !  j2 .  With  respect  to  Pc.  D  (X)  has  then  a  density  f  given 

by  the  relation  f(x)  =  (1-e)^  (x)+ef2(x) .  Let  lA  be  the  indicator  of  the  closure  of 

•  | 

the  range  of  A  and  B,pa,pn  and  s  have  the  same  meaning  as  in  A.  One  then  has, 
if  K  =  {  |A*R*s|  i2/(c+trace(ARp)  +  !  |  A*a  1 12},  pa-pn  =  Kl^s)?  (x2-1)exp(-ix2)dx//*w. 
The  next  proposition  shows  that  the  pathologies  illustrated  in  Proposition  8  and  9 
cannot  occur  in  the  case  of  T2-contaminations.  The  reason  is  clear:  e  is  not  inde¬ 
pendent  of  Q.  There  is  a  restriction  however:  s  is  required  to  belong  to  the  range 
of  Rp. 

Proposition  13 

Let  s  belong  to  the  range  of  Rp  and  W-lim  p£  -  P,  then  lim  p*  *  on./ 

A  simple  limit  calculation  W  gives  the  relative  behaviour  of  pa  and  pn:  pn  tends 
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to  zero  faster  than  Da . 


ProDosition  la 


For  fixed  e  and  large  2,  p  /p  -x,  a2./ 

Finally,  we  consider  again  the  actual  likelihood  and  the  actual  orobability  of 
false  alarm,  still  denoted  d3  .  In  contrast  to  the  case  of  T  1-contaminations,  the  func¬ 
tion  k  of  Proposition  10  is  bounded  for  T2-contaminations.  indeed,  if  K.(x)  =  c*!  fA'  (x-a)  I1 
dPc  =  {K  /(c+C))dP.  so  that,  if  k(x)  =  K(x-s)/Kfx) ,  dP^/dP0  =  k(dPs/dP) .  Then 
Proposition  IS 

Let  a.  belong  to  the  kernel  of  A,  \  =  i{1  +  U+1»c/«As,s>|  and  A..  =  H1-(l+i*c/<As,s>} 

Am  “ 

Then  k(a+A  s*a)  <  k(x)  <  k(a+A..s«-a. ) ./ 
m  a  _  «  A 

From  Proposition  15  one  can  get  a  result  which  is  more  satisfactory  than  Prot>osi- 
tion  12.  but  which  is  still  insufficient  in  the  sense  that  it  depends  on  a  priori  know¬ 
ledge  on  the  perturbations,  which  is  unlikely  to  be  available. 

Proposition  16 

If  s  is  in  the  range  of  R-,  and  iim  sup  C_/ c  <  »,  then,  when  W-lim  P0  =  P. 

r  n  n  n 

Iim  P^idPl  /dP^>a)  =  P{dPs/dP>a>./ 
n  n, s  n  » 

5.  SUMMARY 

Let  p^  =  P{dPs/dP>a),  the  probability  of  false  alarm  for  the  Gaussian  model, 
p2  *  Pc(dPs/dP>a),  the  probability  of  false  alarm  for  the  "exact"  model  when  the 
detector  is  the  likelihood  for  the  Gaussian  model,  and  p^  *  Pc(dPj/dPC>«}.  the 
probability  of  false  alarm  for  the  "exact"  model.  We  have  considered  the  case  ofa 
Gaussian  detection  model  which  is  only  an  approximation  to  an  "exact"  contamina¬ 
ted  model  and  compared  the  quantities  p^.pj.and  p^  when  the  law  P6  of  the  "exact" 
model  is  close  in  the  topology  of  weak  convergence  to  P,  the  law  of  the 
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nominai  model,  which  in  the  oreseni  case  is  Gaussian.  We  have  seen  that  the 
quantities  'p,-p.  |  ana  p. /pj.  i=2. 3,  depend  on  the  type  of  contamination  as  well 
as  on  the  distance  between  P  and  Pc.  Procosition  9  shows  for  example  that  one 
can  have,  for  a  Tl -contamination,  'pi-p,’  >  «;  >0.  though  s  and  the  distance 
between  P  and  Pc  are  negligible.  ProDosition  16  shows  however  that  unaer  fairlv 
mild  restrictions,  'p^-p^l  is  smail  as  soon  as  P  3nd  Pc  are  close  and  Pc  is  a  T2- 
contamination.  We  have  also  shown  that  looking  at  the  likelihood  can  be  rather 
misleading  when  the  model  is  not  exact" 

6.  OUTLINE  OF  PROOFS 

The  proof  of  Proposition  4  is  based  on  four  lemmas  which  we  first  state. 

Lemma  1 

Let  Sc.HfP0)  and  U  be  defined  as  in  Proposition  4.  For  f  in  LfP0)  define 
Pc 


Ff:H-!R  by  the  relation  Ff(h)  =  /  f(x)X(h}  (x)  Pc  (dx) .  Let  H(Sc)  *  {Ff,f  in  L(PC)>, 

<Ff,F  >  =E  (fg)  and  U_  :  L(PC)-*H  (SJ  be  defined  by  the  relation  Uc  f  =  Fr. 

9  H<SC)  pc  5C  c  5c  f 


Then 

1)  H(Sc)  is  a  Hilbert  -oace  (the  reproducing  kernel  Hilbert  space  of  X)  and  is 

c 

unitary  operator, 

2)  IIMOII  1  lIsJllMlhiOlIn  . 

3)  the  two  sets  H(P°)  and  range  (S*)  are  equal, 

4)  <sj[h,Sj[k>  =  <h,k>,  so  that  S^:  H-^H  (Pc)  is  unitary, 

C  C  H (Pc)  C 

Upcf  *  Sch  an<*  fn  =  x*hn*'  lhen  f  *  Hm  fn  if  and  only  if  h  *  lim  S*hn,  in  L(PC) 
and  H  respectively./ 
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Lemma  1  follows  from  the  definitions  and  first  principles.  These  also  yield 
Lemma  2 

.4  t  , 

If  Rp  is  injective,  trace  (ARp)  =  ';'RpAR^!j  if  and  only  ifA  =  h0h./ 

Lemma  3 

If  Pc  is  a  T2-contamination  and  T+rtSt  is  the  operator  of  Proposition  2, 
o(T+rt0t)  >  -I ./ 

pf.  :  It  suffices  to  prove  that  -1  is  not  an  eigenvalue  of  T+xt@t  and  this  follows  from 
the  inequality  1+{(1+<T,h  h>)^-1 }  <  j  ( b [  j  <  1 ./ 

Lemma  4 

Let  T  =  T+t  t©t .  Then 

1)  R*  and  Rp  have  the  same  range  and  R‘  =  Rp(l*T)  *VC,  where  Vc  is  unitary, 

2)  the  map  B:  L(PC)-+H  defined  by  the  relation  Bf  =  R^S^U  f  is  linear  and  continuous./ 

P  pC 

EL  :  D  follows  from  Lemma  3,  (5)  and  the  polar  decomposition  (22) .  B  is  well 

defined  on  H*  and,  if  f  is  in  H*.  |  (Bf  |  j  <  K  j  |f  1 1  ./ 

L(PC) 


Proposition  4 


pf.:  Let  f  =  X{h  ).  Then  f  =  lim  f  by  Lemma  1,  so  that,  by  Lemma  4,  Bf  =  lim  R‘h 
*—  n  n  n  ~ 

Furthermore,  E  (f)  =  lim  <mr,,h  >+<b,Bf>,  so  that  lim  <mp,h  >  is  a  continuous 
pC  P  n  r  n 

linear  functional  on  L(PC) .  The  first  part  of  1)  follws  by  the  Riesz  theorem  and 
Lemma  1 .  If  m^  belongs  to  the  range  of  Rp,  <mp,hn>tends  to  <Rp*rr»p,Bf>  .  The  result 
on  the  variance  follows  from  Lemma  4  and  that  on  the  characteristic  function  from 
Proposition  3./ 

Proposition  5 

El-  :  For  e,x,  and  y  in  the  open  ur''t  interval,  fetf£(x,y)  =  (1-e)x«-ty,  If0<a<1, 
there  is  a  B  in  the  open  unit  interval  such  that  fc(x,y)  >  1-9  implies  x  »  1-o  and 


y  >  1-a.  Consequently,  if  (P  ,  X  in  A)  is  relatively  compact,  so  are  (P  xin  A} 

A  A 

and  (Q  ,  X  in  A),  provided  e,  -  z  and  t  is  in  the  ooen  unit  interval. 

A  ' 

c  >  c 

Suppose  now  (P  ,  X  in  A  }  converges  weakly  to  P  so  that  0  <  lim  inf  e,  <  lim  sup  e  <1 
A  A  X 

If  {Pn,n  in  N}  is  a  subsequence  of  {P  , X  in  A),  let  (e  'converge  to  e  in  the 

^  nk 

open  unit  interval .  SetPc,£=  (l-s)P  ^zQ  .  {Pc c}  converces  weakly  to  Pc . 

nk  nk  nk  -■>',< 

The  remarks  at  the  beginning  impiy  that  {P  }  is  relatively  compact.  The  proposi- 

K 

tion  follows.  To  see  that  the  limit  is  not  necessarily  a  contamination,  consider  (Pc } 

n 

with  P^  =  ( 1  —  e)  P+eQn,  P^  N(0,Rp).  Qn  %  N  (0,  R*  £I-Tn)  R7) .  Tn  =  ((1/n)-1)u0u, 
u  a  unit  vector./ 

Proposition  6 

El  :  Because  of  (9),  Pc  has  characteristic  function  given  by  the  relation 
♦  (h)  =  {1+i<b.h>-<Bh,h>}exp{i<m,h>-i<Sh,h>} ,  where  B  and  S  are  bounded 
linear  operators.  Since  the  convolutions  {P^*P^}  converge  weakly  to  {PC*PC}, 
the  latter  has  characteristic  function  | ♦  (h)  S 2  ~  i<b,h>2-*-(1-<Bh,h>)  2}exp{-<Sh,h>). 

|*  (h)  |2  is  continuous  in  the  S-topology  and  thus,  if  {xp}  converges  weakly  to 

s 

zero,  lim  !$(xn)  | 2  =  1 .  Consequently,  lim  sup  <Sxn,xn>  <  » .  If  this  limit  is 

positive,  choosing  if  necessary  a  subsequence,  one  may  assume  that  lim  <Sxn,xn>  =  o2>' 

One  then  has  that  lim  {1-t2<Bx_,xn>}  =  exo{c2t2},  so  that  lim  <Bx„.x  >  =  0  and 

n  n  n 

i 

consequently  that  lim  <Sxn,xn>  =  0.  S7  is  thus  compact  and  thus  so  is  S.  From  the 
inverse  Fourier  transform  of  ♦,  one  obtains  that  <Bh,h>  <  <Sh,h>,  so  that 
B  =  S^TS^,  T  bounded. 

1)  yields,  as  in  the  proof  of  Proposition  5,  that  (P^J  is  relatively  compact,  so 
thet  (Rn)is  compact.  2)  yields  that  P^  hasa  Fourier  transform  *n  such  that 
U(h)  |2  <_exp{-(1-«  )<Rnh,h>),  which  also  implies  that  (R  }  is  compact.  That 
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S  has  finite  trace  foilows  then  from  *20)  ./ 

Proposition  7 

pf •  :  Recall  that  Pand  P°  have  been  assumed  equivalent.  Using  the  result  (1) 
and  u  orthogonal  and  and  v  equivalent  imply  u  and  v  orthogonal",  one  can  see 
that  the  problem  (P^P^)  is  either  singular  or  nonsinguiar  and  that  it  is  nonsin¬ 
gular  if  and  only  if  the  problem  (Pi,P2/  is  nonsinguiar . 

Suppose  then  that  the  problem  (P^Pj)  's  ncnsingular .  The  operators  R^R^, 
i(R|+R2)  have  all  a  square  root  with  the  same  range  (161  and.  by  Lemma  4  of  6., 

R  .  and  R.,i=1,2,  have  a  square  root  with  the  same  range.  Thus  m_  ,-m  ,= 

1  *  C ,  l  c  f  2 

m1-m2+R|b1-R^b2  belongs  to  the  range  of  the  square  root  of  i(Rc  ,+Rc  •  The 

polar  decomposition  and  the  equality  R,  =  R2(I+T)R‘  yield  R1  =  RJ  (l+T)  2V  where  V 

1  1  1  2  1 

is  unitary  (R1  may  be  assumed  injective  by  restricting  attention  to  the  support  of 

P,) .  Usino  again  Lemma  4  of  6. ,  one  can  write  R_  =  R*  ,WR*  . ,  where  W  is  a 
1  -  c,  1  c,l 

±  1 

product  of  operators  which  are  either  unitary  or  of  the  form  (l+Ul-2,  with  U 

Hilbert-Schmidt  and  a  (U )  >- 1 .  Unitary  operators  always  appear  in  pairs  involving 

.  * 

the  operator  and  its  adjoint.  Since  {l+U)±2  can  always  be  written  in  the  form 
1+0  with  U  Hilbert-Schmidt,  W  has  the  form  l+S,  S  Hilbert-Schmidt.  To  see  that 
o(S)>-1,  it  is  sufficient  to  remember  that  R  and  R  have  square  roots  with 

I  C  f  4 

identical  ranges,  so  that  l+S  is  invertible.  The  reverse  implication  is  proved 
similarly./ 

Proposition  8 

•»  x 

gf_.  :  Let  H  (s)  be  the  subspace  spanned  by  s  and  H  (s)  be  its  orthogonal 
subspace.  Let  Ti (£)  denote  the  projection  onto  H(s)  and  n(sf  the  projection  onto 
H(s)  .Set  Tq  =  9TI Cs) .  Then  t  =  (1+e)^.  Since  6  can  be  any  real  number  strictly 
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larger  than  -1 ,  t  can  take  any  positive  value.  As  a  function  oft,  cj*(3)-*(?t)! 
is  a  convex  function  with  a  minimum  at  t  =  1  and  extreme  vaiues  at  t  =  O.wnere  its 
value  is  £0(3)-*}.  and  at  t  =  ® ,  where  its  value  is  c(1-S  (2)).  Furtermore,  for 


♦  (6)  >  3/4,  * (S)-i  >  1-> (3) . 

{P^}  converges  weakly  to  P  if  and  only  if  either  '  converges  to  zero  or  (Qk> 
converges  weakly  to  P.  If  the  former  obtains,  lim  ipk-ok|  =  0.  Let  {ak}  be  a  se¬ 
quence  of  positive  numbers  whose  sum  is  finite .  Define  9.  .  =  0  for  1  =  1,...,  k-1 , 
9k  k  =  ?k  being  defined  below,  and,  for  I  >k,  ?k  j  =  Let  sk  =  <s,ek> 

and  choose  (9,  }such  that  lim  9  s2  =  *  .  Then  Z  { s 2 /  (1+9.  . ) }  >  9,  sr  .  so  that 

K  KK  Ik  K,i~KK 

t,  <  (9i,s^}"^  and  lim  t.  =  0.  Now,  <R  h.h>  =  <RDh,h>+t,  Z  9.  X<e.,h>2. 

k  -  k  k  k  pC  P  K|=k  '  1 

k 

Since  the  sequence  {9.  .}  is  uniformly  bounded,  lim  <R  h,h>  =  <R  h,h>  . 

K.l  pc  * 

k 

Furthermore  trace (R  )  is  bounded  and  Z  <R  e  ,e  >  converges  uniformly  to 

pk  l=m  pk 

Q 

zero  as  m  increases  to  infinity.  This  insures  that  W-lim  P  =  P  (13)./ 

k 


Proposition  9 


-i 


gf.  :  Set  sk  =  Xkek.  Then  I  lR  * ®k!  1  =  1.  3  =a  and  sk  =  Rp' sk/  |  jRp  skH  =  ek_ 

Let  Tq  =  ekn(sk),Then,  as  in  the  proof  of  Proposition  8,  tk  =  (1+ek)*, 
k 

<R  ch,h>  =  <R  h,h>+ek9kXk,  trace(R  c)  =  trace  (Rp)  +ekekxk'  and 


Z  <R  e,,e.>  <  Z  <R  e, , et>+e,  9.  X.  .  It  thus  suffices  to  choose  {9  }  such  that 
.  _c  i  -  ,  pi  i  k  k  k  k 

l=m  PR  l=m 

lim  9k  =»  and  lim  9k*k  =  0.  / 

Proposition  10 

pf.  :  Fix  g  so  that  it  is  not  orthogonal  to  s  and  r  >  -  j  JR^  H2.  Set  g  =  Rpg/ 1  [Rpg 
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1  t 

and  y  =  -r'|R‘gjj2/(1+r|[RIg|!2).  Let  n  (o )  be  the  projection  onto  H  (g)  and 
P  P 

H(g)  be  that  onto  H  (g)  .Then,  ifT^  =  yi!(g),  (I+Tq)  1  =  M  +r  1  ■  R^g  '  ‘ 2)  "  (q) -It  (g)  = 

l+Rp(rgOg)Rp.  So  G  =  fg©g  and  K(x)  =  (1-e)-»-£(1-«T  J  jR^a  j  !2)*exp{- 

Set  <g,x>  =  y,  <g,s>  =  a,  — iFy2  =  P(y)  .  k  can  then  be  expressed  in  the  form 

k*(y)  =  {A+Bexp{P(y-a)  }}/{A+Bexp{P (y) }} .  If  L(y)  =  P'  (y)exp'P(y)  }/ (A-Eexp-'P  (y) } 

then  (d/dy)k*(y)  =  Bk* (y){L (y-a) -L (y) } .  Now,  for  r<0.  L  is  strictly  increasing. 

so  that  the  graphs  of  L(y-a)  and  of  L(y)  are  parallel  and  do  not  meet  (because  of 

the  assumption  that  a  is  different  from  zero,  that  is,  g  a^a  s  are  not  orthogonal)  . 

The  derivative  of  k*  has  thus  constant  sign  and  k*  is  a  monotone  function  which 
is  unbounded  and  positive./ 


Proposition  11 

pf.  :  It  suffices  to  establ  ish  that  sup(k  (0)  •  e,G)  =  exp(i  j ! Rp^s  j  j .  One  has 
that  <Gs.s>  =  j  iRp^s]  ] 2<R^CR^s,  s>.  Since  (l+T^)  1  =  1+RpGR^,  <RpCR^s,s>  >  -1 
and  thus  -J<Gs,s><  i!iRp*s|j2  .  Conseauently 

k (0)  <  (e+(1-e)detl(l+T  )}_1{(1-e)det*(l+TQ)+eexp{-iI  |Rp*s!  p}).  For  a  and  b 
positive  and  c  strictly  larger  than  one,  the  function  (a+bcx)/  (a+bx)  is  increasing 
and  bounded  by  c.  Thus  k CO)  <  expU  j  iRp^s |  !2>. On  the  other  hand,  if 
X  =  (l-e)det*  0+Tq)  and  u  =  c, 

k  (0)  =  (X+y  )_1{Xexp{-i|  |Rp^s!  |2)+uexp(-i<  (l+T  ) _1  s,  s>}}  expfl  |  |Rp*s  |  | 2) . 
So,  by  convexity, 

k (0)  >_exp{-i  (X+u  )  -1  (X  |  |R~is|  |2+u  !  |  d+TQ) ~^s !  i2H  expU  |  'Rp^sl  !2>  • 

If  Hn  is  the  subspace  spanned  by  e1 . en,  TIn  th\»  projection  onto  Hn  and 

that  onto  H  ,  set  T=  nn_  and  t  =  1  - { 1  /  (1  -m)  )n  .  Then  det^  (l+T  )  =  (1-*-n)^n 
n  Q  n  n  q 

and  1 1  (I+Tq)~^s|  |2  =  (1+n)  1  j  |nns|  j2  +  |  |nns|  !2.  Taking  the  limit  as  n  grows 
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yields  k(0)  >  exp{j  !  |Rp7s!  ;3  :./ 

Proposition  12 

pf-  '•  When  Cn  is  nonnecative.  <  kn(xj  <  3n  and  thus 

Pn{dPs/dP>'M:‘  -  Pn-dPn.s/dPn>3}  1  Pn’dP5/dP->  */M  >•  Since  dPs/dP  is  a 
continuous  function,  the  resuit  follows  from  the  properties  of  weak  convergence.. 
Proposition  13 

pf-  '•  Let  h*  =  Rph/  I  ;Rph  I  ] .  One  then  has  that  E^fexpfiXfh}}}  = 

{1-<RpARph*,  h*><Rph,  h>/ {trace  (ARp)  *  | |A*a  j  !2}}exp{-i<Rph,h>}.  So,  if 

; 

W-lim  Qn  =  P  and  k  is  a  vector  in  the  range  or  Rp,  with  norm  eoual  to  one, 
lim  en  =  lim  I’A^R^k!  j2/{trace(AnRp)  +  !  |A^an!  I2}  =0./ 

Proposition  14 

gf.  :  To  obtain  the  extreme  values  of  k,  one  studies  the  function  k(s*+tx)  as  3 
function  oft.  It  turns  out  that  s*  must  be  of  the  form  s*  =  a+Xs+aA,  with  a^  in 
the  kernel  of  A,  for  s*  to  be  extremal.  X  is  obtained  using  this  representation./ 
Proposition  15 

pf.  :  If  X  corresponds  to  s*  .  and  X,.  to  s*  in  the  proof  of  Proposition  14, 
m  min  M  max 

then  PC{D  (X)  >loga-logk(a+Xms+a^)}  <_Pc\dP^/dPc>a)  <_PC{D  (X)  >loaa-logk  (a+X^s+a^) 

Then,  if  d  =  4c/<As,  s>,  k(a+X  s+a.)  =  {1  +  (1+d)*  >/{  (1+d)  *-l ),  which  increases 

m  A 

c 

strictly  from  zero  to  one  as  d  goes  from  zero  to  infinity.  If  now  W-lim  Pn  =  P 
and  lim  sup  Cn/cn  <  «,  lim  <Ans,s>/4cn  =  0  and  lim  k(an-Xn  mS’-aA  )  =  1./ 
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